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A plastic container sorter (10) moves labeled plastic 
containers (14, 20, 48, 54, 58) of various colors and 
transparencies through an inspection zone (18). A pair 
of line-scanning color cameras (22, 24) capture respec- 
tive transmittance and reflectance images of the con- 
tainers and generate raw transmittance and reflectance 
image data. The raw container data are digitized, nor- 
malized, and binarized to provide accurate transmit- 
tance and reflectance container RGB image data and 
binarized image data for differentiating container image 
data from background data. Container sorting entails 
eroding (120) the binarized transmittance image and 
merging (122) the eroded image with the transmittance 
image data to yield a transmittance image. The eroded 
transmittance image is analyzed (124, 126) to determine 
whether the container is opaque. If the container is 
opaque, color analysis proceeds by analyzing the reflec- 
tance image data. If, however, the container is not 
opaque, transmittance image data are used to classify 
the container as green transparent (140), translucent 
(142), or clear transparent (142). Classified containers 
are transferred to an ejection conveyor (46). Side dis- 
charge of a classified container is effected by an air 
ejector (64) blast that is timed in response to sensing a 
particular container adjacent to an appropriate side 
discharge station (60). 
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FIG. 6A 
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FIG. 6B 
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FIG. 6C 
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FIG. 6D 
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FIG. 6F 
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PLASTIC CONTAINER SORTING SYSTEM AND 
METHOD 

TECHNICAL FIELD 5 

This invention relates to inspection and sorting sys- 
tems and more particularly to an apparatus and a 
method for inspecting and sorting plastic containers by 
combinations of their light transmittance and reflec- 
tance characteristics, and for avoiding sorting errors 10 
caused by labels affixed to the containers. 

BACKGROUND OF THE INVENTION 

Growing environmental awareness has developed a 
market need for recycling plastic items. Such items are 15 
made from nonrenewable petrochemical resources, 
consume diminishing landfill space, and decompose 
very slowly. The market for recycled plastic is cost 
sensitive, and its ultimate size, success, and profitability 
result from the degree to which automated systems can 20 
sort a wide variety of plastic items and, in particular, 
plastic containers such as beverage bottles. Plastic con- 
tainer sorting has value because containers consume an 
inordinate portion of landfill volume. 

Systems and methods are already known for sorting 25 
plastic items by size, color, and composition. In particu- 
lar, U.S. Pat No. 5,150,307 for a COMPUTER-CON- 
TROLLED SYSTEM AND METHOD FOR SORT- 
ING PLASTIC ITEMS describes a sorting system in 
which baled plastic items, including containers, are 30 
broken apart into pieces, singulated on a split belt, and 
spun to lengthwise orient them for inspection by a 
length-detecting photocell array and an RGB color 
reflectance imaging camera. When the length is known, 
the center of each item is estimated so that most back- 35 
ground data can be eliminated from the RGB reflec- 
tance image to speed up a time-consuming composition 
and color analysis. Reflectance images are subject to 
color contamination by labels, so the system performs 
an image grid analysis by which an image edge is lo- 40 
cated and the dominant RGB color is determined for 
each grid element located along the image edge. The 
item edge is assumed to include a minimum of color- 
contaminating label data. Item discharge utilizes a dis- 
charge conveyor position-synchronizing rotopulse, an 45 
item-indicating photoeye, an item-sorting mechanical 
distribution gate, and an item-discharging air ejector. 

Such a sorting system is costly, overly complex, and 
prone to unreliability. Spinning items to achieve the 
lengthwise orientation increases the probability that 50 
adjacent items can be knocked into misalignment. 
Length and center determination, coupled with back- 
ground elimination, edge determination, and grid analy- 
sis, is an overly time-consuming color analysis method 
that is subject to edge-induced color errors. Moreover, 55 
using only a reflectance image does not provide for 
optimal analysis of transparent and translucent items. 
Finally, because they are light and have a variety of 
shapes and sizes, plastic containers tend to float, roll, 
and shift position easily on a conveyor belt. Even 60 
though the above-described sorting system can handle 
plastic containers, it is needlessly complex, potentially 
unreliable, and therefore not optimally cost effective for 
sorting plastic containers. 

U.S. Pat No. 5,141,110 for a METHOD FOR 65 
SORTING PLASTIC ARTICLES describes using 
polarized light and crossed linear polarizers to classify 
the composition of transparent or translucent plastic 
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2 

articles as either polyethylene terephthalate ("PET") or 
polyvinyl chloride ("PVC")- Color analysis entails 
using an unacceptably slow mechanically positioned 
color filter technique. Opaque plastic articles are in- 
spected with scattered and/or refracted X-rays, a 
known hazardous technique. The patent does not de- 
scribe how color analysis is accomplished for opaque 
articles. In any event, proper inspection is said to re- 
quire delabeling or otherwise avoiding labels, but no 
way of avoiding labels is described. 

U.S. Pat. No. 4.919,534 for SENSING OF MATE- 
RIAL OF CONSTRUCTION AND COLOR OF 
CONTAINERS describes using two wavelengths of 
polarized light to determine the composition and color 
of transparent and translucent containers. In particular, 
determining the composition as glass or PET and fur- 
ther determining color entails calculating a difference in 
the transmitted intensity for polarized light at each of 
the two wavelengths, normalizing by the sum of the 
transmitted intensities, and using the normalized differ- 
ence as a color index for characterizing the color of the 
container. Labels are considered opaque and are, there- 
fore, ignored. Opaque containers cannot be analyzed by 
this technique. 

U.S. Pat. No. 5,085,325 for a COLOR SORTING 
SYSTEM AND METHOD, assigned to the assignee of 
this application, describes using line-scanning cameras 
to sort moving articles on the basis of reflected RGB 
colors of visible light. Colorimetric accuracy is ensured 
by normalizing the light sensitivity of each camera sen- 
sor element, digitizing each RGB pixel value, and using 
the digitized value as an address into a color lookup 
table ("CLUT") that stores predetermined accept- 
/reject data. The CLUT address is an 18-bit word 
formed by concatenating together the six most signifi- 
cant bits of each R, G, and B normalized and digitized 
color data. Such color data are said to be in a three-di- 
mensional color space. CLUT output data can be size 
classified by a filter lookup table ("FLUT") and/or 
image processed in an image memory. Statistical- and 
histogram-based methods for loading the CLUT and 
FLUT with accept/reject and filtering data are also 
described. This system is primarily used to detect spot 
defects, such as eyes, in opaque articles, such as potato 
strips. 

What is needed, therefore, is a simple, cost-effective 
plastic container sorter that is capable of accurately 
classifying labeled containers of any size, opacity, trans- 
parency, color, or orientation. Moreover, plastic con- 
tainers are positionally unpredictable because their 
shape and light weight allows them to slip, roll, and 
slide during inspection. Therefore a simple and reliable 
system is needed for tracking and ejecting the classified 
containers, 

SUMMARY OF THE INVENTION 

An object of this invention is, therefore, to provide an 
apparatus and a method for sorting plastic containers by 
degree of transparency and color. 

Another object of this invention is to provide an 
apparatus and a method for removing edge and label 
color contamination from color sorting decisions. 

A further object of this invention is to provide an 
apparatus and a method for accurately sorting moving 
articles that are positionally unstable. 
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Still another object of this invention is to provide a DETAILED DESCRIPTION OF PREFERRED 

cost-effective plastic container sorter having improved EMBODIMENT 
sorting speed, accuracy, and reliability. 

A sorting apparatus and method according to this A general description of a plastic container sorter 10 

invention entails moving labeled or unlabeled plastic 5 according to this invention follows with reference to 

containers of various colors and transparencies across FIGS, land 2. A plastic container 12, having a label 14, 

an inspection zone. A pair of line-scanning color cam- *? P laced on a presentation conveyor 16 for accelera- 

eras capture transmittance and reflectance images of the tion ' stabilization, and propulsion through an inspection 

containers and generate respective raw transmittance , A zo ° e . „ A . . , . , 

o«h rnfl^^J**^ ~>.„ ^ ; ^ 10 A plastic container 20, having a label 21, passes 

and reflectance image data. The raw container image Al *\ • , °. . «. • r , 

data are digitized, normalized, processed, and binarized j? 0 ^*^ 

to provide accurate ^nuttance and reflectance con- ^ ^^ttef ight^g ("transmittance") cam- 

fcuner image data together with bmanzed image data for era ^ for generation of respective reflectance and 

differentiating container image data from background 15 transmittance video images of plastic container 20 and 

label 21. Light from a pair of very-high-output 
Container sorting entails eroding the binarized trans- ("VHO") fluorescent lamps 26 is focused on inspection 
mittance image and merging the eroded image with the ZO ne 18 by associated parabolic reflectors 28. Reflec- 
normalized transmittance image data to yield an eroded tance camera 22 receives light reflected from plastic 
transmittance image that is free of noise and edge color 20 container 20 as it passes through a scanning plane 30. 
effects. The eroded transmittance image is analyzed to Reflectance camera 22 views plastic container 20 
determine whether the container is opaque. If the con- against a nonreflecting dark-cavity background 32. 
tainer is opaque, color analysis proceeds by using the Transmittance camera 24 receives light transmitted 
reflectance image data. The binarized reflectance data through plastic container 20 as it passes through a scan- 
are twice eroded, and the once and twice eroded images 25 plane 34. The transmitted light originates from an 
combined to yield a binary trace ring. The binary trace illuminated background 36. Line scanning cameras 22 
ring is merged with the normalized reflectance image and 24 generate respective reflectance and transmit- 
data to yield a color trace ring that is free from noise, ^tn streams while plastic container 20 
color edge effects, and most label color contamination. inspection zone 18. By the time plastic 
The opaque container color is the average RGB color 30 «> nt f"* ™ enters a transfer chute 38, sufficient video 
of the color trace ring. If, however, the container is not *™ generated to capture and process a re- 
opaque, normalized transmittance image data are used fleC * a ? ce ™ ge md a transrmttance m *& A ° f P*** c 

to classy the container as green transparent, translu- C ° T Dtamer 20 m TeS ^ Ve P™™ V* **' 

-"^J Jr + F ' Image processors 40 and 42 receive the reflectance 

cent, or clear transparent. , 35 and transmittance video as serial bit streams of ampli- 

Classified containers are ttansferred to an ejection tode modulated> repe ating cycles of, red C'R"), green 

conveyor havmg multiple side discharge stations hav- ( « G »^ ^ blue bits# ^ re flectance and trans- 

ing associated container sensors and air ejectors. Side mittance RGB bit streams are each digitized, amplitude 

discharge of a particular classified container is effected normalized, sorted into RGB color components, and 

by an air ejector blast that is timed in response to sens- 40 built into RGB and binarized images for transparency 

ing the particular container adjacent to the appropriate and color analysis by a general purpose processor 44. 

side discharge station. General purpose processor 44 receives RGB reflec- 

Additional objects and advantages of this invention tance image data and binary reflectance image data 

will be apparent from the following detailed description from reflectance image processor 40 and receives RGB 

of a preferred embodiment thereof which proceeds with 45 transmittance image data and binary transmittance 

reference to the accompanying drawings. image data from transmittance image processor 42. A 

container sorting program processes the transmittance 

BRIEF DESCRIPTION OF THE DRAWINGS data to determine whether container 20 is opaque. If 

FIG. 1 is a simplified schematic side elevation view of container 20 is opaque, the sorting program processes 

a plastic container sorter according to this invention. 50 reflectance data to determine the container color. 

FIG. 2 is a simplified isometric pictorial view of a Co,or contamination from label 21 is avoided by the 

plastic container sorter according to this invention. sorting program If container 20 is not opaque, the 

FIG. 3 is a fragmentary simplified isometric pictorial transmittance data are further processed to determine 

view of a container being inspected in an inspection « wh * te ' <* mtamcr * »» ^ n translucent, 

zone of the plastic container sorter according to this 55 or clear transparent. General purpose processor 44 asso- 

invention 5 ciates the proper sorting classification with container 20 

FIG. 4 is a simplified schematic block diagram show- en **f hese mt0 * container sorting queue. 

. p ™7 .T. . ^ An ejection conveyor 46 transports previously ana- 

ing an image processor accordmg to this invention. lyzed containers 48, 50, 52, 54, 56, and 58 through a 

FIG 5 is a flow chart showing the processing steps ^ seriesof ejection stations 60 each having a pair of photo- 
executed to sort plastic containers according to this electric container sensors 62 and associated air ejectors 
m ^^° n * _ 64. When a particular photoelectric container sensor 62 

FIGS. 6A-6F are pictorial representations of plastic senses a container, an associated bit is set in a container 

container digital image data taken at various points in sensor register 66. Likewise, a particular air ejector 64 is 

the processing steps indicated in FIG. 5. 65 actuated in response to an associated bit being set in a 

FIG. 7 is a fragmentary simplified isometric pictorial container ejector register 68. Container sensor register 

view of a container being ejected off an ejection con- 66 and container ejector register 68 are electrically 

veyor according to this invention. connected to general purpose processor 44. The con- 
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tainer sorting queue is flushed in response to signals 34 measures 0.4 by 30.5 centimeters. Up to one hundred 
from container sensor register 66 such that appropriate successive scans are used to scan adjacent 0.4 centime- 
ones of air ejectors 64 are actuated at the correct times ter sections of plastic container 20 as it passes through 
to eject previously analyzed containers from ejection viewing zone 18. Sufficient image data are collected to 
stations 60 into appropriate collection bins 70. 5 store a 75 by up to 100 triad image of an object, such as 

The foregoing general description of plastic con- plastic container 20, passing through viewing zone 18. 
tainer sorter 10 proceeds in more detail with reference The effective image size is, therefore, 30.5 by up to 40.5 
to FIG. 3. centimeters. 

Presentation conveyor 16 moves in a direction indi- Another problem with triad-based color cameras is 
cated by an arrow 80 at a fixed rate ranging from 30 to 10 that certain CCD array chips have differing signal out- 
213 meters per minute, with the preferred rate being 152 put values between odd- and even-numbered elements, 
meters per minute. Presentation conveyor 16 is prefera- For example, every other triad may have high-red, 
bly 30.5 centimeters wide and has a surface tilt angle 82 low-green and high-blue values, whereas the other (in- 
in a range of from 5 to 20 degrees, with the preferred terleaved) triad may have low-red, high-green and low 
angle being 7.5 degrees. Surface tilt angle 82 is defined 15 blue values. Alternating color distortion results if all 
as the angle formed between an imaginary horizontal triads are used to generate an image. Because plastic 
line 84 and an imaginary line 86 intersecting the planar container sorter 10 uses triads spaced apart by three 
surface of presentatioa conveyor 16 in a direction trans- unused triads, alternating color distortion is eUminated. 
verse to arrow 80. A slick side barrier 86, preferably Any odd-numbered triad spacing would also eliminate 
TEFLON®, is mounted adjacent to an elevationally 20 alternating color distortion. 

lower side margin 88 of presentation conveyor 16. Slick Cameras 22 and 24 are each fitted with a NIKON 50 
side barrier 86 provides orientation stability for round millimeter f:1.4 lens set to an f2.8 aperture value. Expo- 
containers placed on presentation conveyor 16. The sure time for each camera scan is 1.5 milliseconds. Focal 
angular orientation of plastic container 20 in inspection plane to viewing zone 18 distance is preferably 130 
zone 18 is not important, but its orientation change is 25 centimeters. Suitable lenses are available from NIKON 
limited to no more than 0.5 degree in any axis per centi- OEM Sales, Diamond Bar, Calif, 
meter of travel through inspection zone 18. Viewing zone 18 requires about 550 foot-lamberts of 

Reflectance camera 22 and transmittance camera 24 illumination for reflectance camera 22 to properly ex- 
each are of a linear CCD array scanning type such as pose its CCD array under the foregoing exposure con- 
model TL-2600 manufactured by PULNDC America, 30 ditions. Sufficient illumination is provided by using a 
Inc., Sunnyvale, California. Cameras 22 and 24 each pair of parabolic reflectors 28 to focus light propagating 
have a single linear array of 2592 CCD elements incor- from associated VHO fluorescent lamps 26 on viewing 
porating repeating groups of alternating R, G, and B zone 18. Each of VHO lamps 26 is a 122 centimeter 
light wavelength filters. Each group of three CCD long, VHO daylight fluorescent bulb driven by an opti- 
elements with respective R, G, and B filters is referred 35 caily regulated power supply such as model FXC- 
to as a triad. Cameras 22 and 24 have 864 triads in the 16144-2 manufactured by Mercron, Inc., Richardson, 
2592 element array and provide a cost-effective solution Texas. Each of VHO lamps 26 is bent into three linear 
for many full color visible spectrum imaging applica- sections including a center linear section and two end 
tions - linear sections, each 41 centimeters long. The lamps are 

Unfortunately, triad-based color cameras have an 40 bent by techniques well known in the neon sign indus- 
"edge effect" problem that causes color shifts at the try. Each of the end sections is bent about 25 degrees 
edges of images scanned by such a camera. The edge relative to the longitudinal axis of the center section and 
effect is caused whenever the CCD array receives a such that the longitudinal axes of all sections are co-pla- 
light wavelength transition, such as that from a con- nar. 

tainer edge. If the light wavelength transition is opti- 45 Each of parabolic reflectors 28 is fabricated by join- 
cally imaged on only a portion of a triad, then only ing a center linear parabolic section and two end linear 
those RGB elements that are imaged will generate a parabolic sections at an angle matching that of VHO 
signal. For example, if a transition from black to red is lamps 26. VHO lamps 26 are positioned within para- 
imaged on only the G and B elements of a triad, no red bolic reflectors 28 such that their respective longitudi- 
signal will be generated. If a transition from white to 50 nal axes and lines of focus coincide, 
black is imaged on only the R element of a triad, only a A preferred distance of about one meter between 
red signal will be generated. Clearly, accurate color VHO lamps 26 and viewing zone 18 provides uniform 
signal generation depends on edges being imaged on all iUummation of an adequately large scanning area to 
elements of a triad. accommodate a large range of container sizes. 

Plastic container sorter 10 reduces edge effects by 55 Dark-cavity background 32 is a 92 centimeter long by 
using data from only every fourth triad and defocusing 3 1 centimeter high box that tapers in width from 8 centi- 
me camera to enlarge the effective pixel diameter by 10 meters at its base to 4 centimeters at its open top. All 
times. This increases image overlap within each triad to interior surfaces are a flat black color to provide a re- 
greater than 95 percent but does not degrade effective flectance of less than 2 percent to visible light having 
image focus, because the triads used are spaced apart by 60 wavelengths ranging from 400 to 700 nanometers. The 
12 pixels. remaining reflectance is lambertion in nature. Dark- 

The effective resolution of cameras 22 and 24 is such cavity background 32 is preferably positioned 92 centi- 
that each triad receives light from a 0.4 by 0.4 square meters beneath viewing zone 18 and is aligned to en- 
centimeter area in viewing zone 18. In each camera, close a terminal portion 90 of reflectance scanning plane 
image data from the center-most 75 actually used triads 65 30. 

are used to store an image of viewing zone 18. Data Light propagating from iUuminated background 36 is 
from other triads are ignored. Therefore, the portion of transmitted through container 20 in viewing zone 18 to 
viewing zone 18 intersected by scanning planes 30 and transmittance camera 24. IUuminated background 36 is 
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preferably an 8 centimeter wide by 122 centimeter long tion zone 18 generates a stream of sequential raw video 
white Ught-diffusing panel that is illuminated by a 122 data values that are digitized by ADC 102, unity multi- 
centimeter long VHO daylight fluorescent lamp 92 plied by digital multiplier 104, and stored in a set of 
driven to approximately 80 percent of maximum bright- sequential data locations in a pixel RAM 108. The raw 
ness by an optically regulated power supply such as 5 video data values stored in pixel RAM 108 are read by 
Mercron Ballast Model HR 2048-2. A glare shield 94 general purpose processor 44 and compared with a 
prevents stray light from VHO lamp 92 from entering preferred standard data value of 220 (decimal equiva- 
reflectance camera 22. IUuminated background 36 is lent of stored binary value). General purpose processor 
preferably positioned at least one meter above viewing 44 calculates the difference between the raw data values 
zone 18 and is aligned such that its long axis coincides 10 and the standard data value and calculates a multiplica- 
with a terminal portion 96 of transmittance scanning tion factor for each raw data value. General purpose 
plane 34. Such a positioning accommodates the passage processor 44 completes the calibration process by stor- 
of oversized containers through viewing zone 18 and ing the calculated multiplication factors in gain RAM 
minimizes the possibility of stray light from VHO lamps 106 at locations associated with each raw data value. 
26 being reflected off bright container surfaces, to illu- 15 Normalization subsequently proceeds when digital 
minated background 36, and into transmittance camera multiplier 104 receives on set A of input terminals a 
24. sequence of raw data values. As each sequential raw 
Objects in viewing zone 18, such as container 20, are data value is received, the multiplication factor associ- 
readily classified as opaque, translucent, or transparent ated with each data value is received from gain RAM 
when scanned by transmittance camera 24 against illu- 20 106 at set B of input terminals of digital multiplier 104. 
minated background 36. Opaque objects, including Digital multiplier 104 generates, at a set A XB of output 
label 21, are easily classified by comparing the light terminals, normalized data values that are stored in pixel 
intensities received by transmittance camera 24 from RAM 108 and which are used to address locations in a 
illuminated background 36 and the object in viewing pixel lookup table ("PLUT") 110. 
zone 18. An object that transmits no more than about 25 The normalized eight-bit data values stored in pixel 
ten percent of the light received from illuminated back- RAM 108 are read by general purpose processor 44, 
ground 36 is indicative of an opaque object. An object assembled into 24-bit RGB triad data values, and stored 
that transmits between about ten and 30 percent of the by general purpose processor 44 as transmittance RGB 
light received from illuminated background 36 is indica- image data. 

tive of a translucent object Classification of objects is 30 Binarization of the normalized eight-bit data values 

described below in more detail with reference to FIGS. provides for differentiating container data from back- 

5 and 6. ground data. Binarization of transmittance data entails 

Cameras 22 and 24 generate respective reflectance prograrnming a logic-0 state into PLUT 110 of transmit- 

and transmittance video data streams that are each digi- tance image processor 42 at all storage locations having 

tized, normalized, and binarized by respective reflec- 35 addresses ranging from 210 to 230 and a logic-1 state 

tance and transmittance image processors 40 and 42. into storage locations having addresses 0 through 209 

Image processors 40 and 42 function as described here- and 231 through 255. Accordingly, all normalized 

after with reference to FIG. 4. Only the processing of eight-bit data values presented to PLUT 110 that are 

transmittance video data by transmittance image pro- within 10 units of 220 are background data values, and 

cessor 42 will be described because image processors 40 40 the others are object data values, 
and 42 are substantially identical. In similar manner, binarization of reflectance data 

Transmittance video data enters transmittance image entails programming a logic-0 state into PLUT 110 of 

processor 42, is conditioned by a video amplifier 100, reflectance image processor 40 at all storage locations 

and digitized to eight bits by an analog-to-digital con- having addresses ranging from 0 to 10 and a logic-1 

verter ("ADC") 102. The digitized transmittance video 45 state into storage locations having addresses 11 through 

data are a sequential stream of alternating red, green, 255. 

and blue raw eight-bit data values that enter an 8X 8 PLUT 110 generates a logic-0 bit in response to each 

digital multiplier 104 at a set A of input terminals for background data value and a logic-1 bit in response to 

normalization. Normalization is a well-known process each object data value. Each no rmalize d data value 

by which sensitivity differences associated with each 50 generates a corresponding bit that is shifted into an 

CCD element in camera 24 are equalized. eight-bit shift register 112 that functions as a serial-to- 

However, normalization first requires that a calibra- parallel converter. For each bit shifted into eight-bit 
tion process be carried out without any objects in view- shift register 112, a corresponding eight-bit parallel data 
ing zone 18. Calibration entails comparing a raw data byte is formed that is stored in a window RAM 1 14. 
value associated with each CCD element in camera 24 55 As was stated earlier, RGB data triads are formed 
with a standard data value, calculating a difference from groupings of three sequential data values. There- 
value for each CCD element, and storing in a memory fore, if any bit, in a group of three sequential bits, that is 
a compensating multiplication factor for each CCD generated by PLUT 110 is a logic-1, the associated triad 
element. is an object triad. If all three sequential bits generated 

During subsequent operation, each raw data value is 60 by PLUT 100 are logic-O, the triad is a background 

multiplied by its associated multiplication factor to pro- triad. This determination is made by a window lookup 

vide a normalized data value. table ("window LUT") 116 that is programmed to logi- 

Image processor 42 starts the calibration process by cally OR the first three bits of each data byte formed by 

receiving from general purpose processor 44 a com- eight-bit shift register 112 as each byte is stored in win- 

mand that initializes all storage locations in a gain RAM 65 dow RAM 1 14. Accordingly, if the output of window 

to a unity value. The 8X8 digital multiplier 104 receives LUT 116 is a logic-1, the most recent three bytes repre- 

the values stored in gain RAM 106 at a set B of input sent an object triad. Otherwise, if the output of window 

terminals. A scan by transmittance camera 24 of inspec- LUT 116 is a logic-0, the most recent three bytes repre- 
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sent a background triad. The binarized data generated 
by window LUT 116 is routed by general purpose pro- 
cessor 44 to a memory. 

By way of example, Table 1 shows representative 
data undergoing the foregoing signal processing steps. 
Container edge transmittance image data from transmit- 
tance camera 24 CCD elements 1187 through 1250 are 
shown making a transition from a semi-transparent 
green value to a background value. Bold highlighted 
data rows indicate every fourth RGB triad that is pro- 
cessed by general purpose processor 44. Of the 75 triads 
used, data from triads numbered 28 through 33 are 
shown. Unused triads are so indicated. Column three 
shows the normalized data values associated with each 
CCD element The normalized data values are pro- 
cessed by PLUT 110 and stored in pixel RAM 108. 
Column four shows the data bit states generated by 
PLUT 110. 

The data in Table 1 are ordered with the most recent 
data shown at the bottom, i.e., CCD element number 20 
1187 is processed first and CCD element number 1250 is 
processed last Column five shows the data bytes 
formed in shift register 112 in response to each bit re- 
ceived from PLUT 110. The data bytes are shown eight 
bits delayed relative to the data bits received from 25 
PLUT 110 as shown in column four. The right-most 
three underlined data bits are those logically ORed by 
window LUT 116 to make a data binarization decision. 
Column six shows the output of window LUT 116 with 
indicating the data bits processed by general purpose 
processor 44 to store a binarized transmittance image. 
Note that the data bit is used because the underlined bits 
in shift register 112 contain data associated with the 
current RGB triad. 
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TABLE 1 -continued 



CCD 


RGB 


Pixel RAM 


Pixel 


Shift 


Window 


Element 


Triad 


Normalized 


LUT 


Register 


LUT 


No. 


No. 


Data Value 


Output 


Contents 


Output 


1223 


31(B) 


132 


1 


main 


0} 


1224 


31(R) 


110 


1 


muni 


1 


1225 


31(G) 


188 




mum 


1 


1226 


unused(B) 


128 




mum 


1 


1227 


unused(R) 


108 


I 


ilium 


1 


1228 


uaused(G) 


184 


1 


mum 


1 


1229 


unused(B) 


121 


1 


mum 


1 


1230 


unuscdfR) 


105 


1 


mum 


i 


1231 


unused (G) 


177 


1 


1H111U 


l 


1232 


unused (B) 


117 


1 


mum 


1 


1233 


unused(R) 


099 


I 


mum 


1 


1234 


unused(G) 


173 


I 


iimiii 


1 


1235 


32(B) 


111 


I 


mum 


{1} 


1236 


32(R) 


097 


1 


mum 


1 


1237 


32(G) 


167 




mum 


1 


1238 


unused (B) 


113 




mum 


1 


1239 


unused(R) 


096 




mum 


1 


1240 


unused(G) 


169 




mum 


l 


1241 


unused (B) 


112 




mum 


1 


1242 


unused(R) 


095 




mum 


l 


1243 


unused(G) 


172 




mum 


1 


1244 


unused (B) 


110 




mum 


1 


1245 


unused(R) 


097 




mum 


1 


1246 


unused(G) 


168 




mum 


1 


1247 


33(B) 


112 




ilium 


{1} 


124S 


33(R) 


096 




mum 


1 


1249 


33(G) 


170 




ilium 


1 


1250 


unused (B) 


111 




mum 


1 
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CCD 


RGB 


Pixel RAM 


Pixel 


Shift 


Window 


Element 


Triad 


Normalized 


LUT 


Register 


LUT 


No. 


No. 


Data Value 


Output 


Contents 


Output 


1187 


28(B) 


220 


0 


00000000 


{0} 


1188 


28(R) 


221 


0 


00000000 


0 


1189 


28(G) 


218 


0 


00000000 


0 


1190 


unused(B) 


216 


0 


00000000 


0 


1191 


unused(R) 


219 


0 


00000000 


0 


1192 


unused(G) 


220 


0 


00000000 


0 


1193 


unused(B) 


217 


0 


00000000 


0 


1194 


unused(R) 


217 


0 


00000000 


0 


1195 


unused(G) 


219 


0 


10000000 


0 


1196 


unused(B) 


215 


0 


11000000 


0 


1197 


unused(R) 


217 


0 


01 100000 


0 


1198 


unused(G) 


221 


0 


11011000 


0 


1199 


29(B) 


214 


0 


1101 1000 


{0} 


1200 


29(R) 


215 


0 


01101100 




1201 


29(G) 


219 


0 


101 10 110 




1202 


unused (B) 


209 




11011011 




1203 


unused (R) 


207 




01101101 




1204 


unused(G) 


217 




101 10110 




1205 


unused (B) 


202 




1I0U0U 




1206 


unused (R) 


201 




0U0U01 




1207 


unused(G) 


215 




101 101 10 




1208 


unused (B) 


197 




uouou 




1209 


unused(R) 


194 




mouoi 




1210 


unused(G) 


214 




uuouo 




1211 


30(B) 


190 




union 


{1} 


1212 


30(R) 


185 




nuuoi 




1213 


30(G) 


211 




niimo 




1214 


unused(B) 


182 




ilium 




1215 


unused CR) 


165 




11111111 




1216 


unuscd(G) 


204 




11111111 




1217 


unused (B) 


157 




mum 




1218 


unusedCR) 


147 




11111111 




1219 


unused (G) 


199 




mum 




1220 


unused(B) 


143 




mum 




1221 


unuscd(R) 


136 




iniini 




1222 


unused(G) 


193 




ilium 
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General purpose processor 44 receives normalized 
and binarized image data from transmittance image 
processor 42 and reflectance image processor 40. FIG. 
5 shows the processing steps executed by general pur- 
pose processor 44 to classify objects such as container 
20 into transparency and color categories. The ensuing 
steps are preferably executed as a C-language program 
by a conventional 50 MegaHertz 486 microprocessor. 
Such a processor and program combination is capable 
of processing containers propelled through inspection 
zone 18 at the preferred 152 meter per minute rate. 
Skilled workers knowing the following processing steps 
can readily provide an appropriate program. 

An erosion process 120 receives the binarized image 
data from transmittance image processor 42 for erosion 
by a diamond-shaped structuring element fitting within 
a three-by-three square area of data. Erosion is a process 
by which data bits not overlaying a predetermined 
structuring shape are erased. Erosion removes "noisy" 
and edge image data to further reduce edge effects. 

A data merging process 122 receives from erosion 
process 120 the eroded binarized image data and com- 
bines them with the normalized RGB transmittance 
image data from transmittance image processor 42 to 
generate eroded and normalized RGB transmittance 
image data with the .background data removed. In other 
words, merging process 122 filters out al] data except 
for nonedge container data. 

A histogram process 124 accumulates the quantity of 
each unique intensity value ((R-|-G-|-B)/3) received 
from merging process 122 to build a light intensity his- 
togram curve for light transmitted through container 
20. 

A decision process 126 determines whether the "dark 
area" under the histogram curve exceeds a user-deter- 
mined percentage, preferably 90 percent, of the total 
container area. 
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If decision process 126 yields a "yes" answer, con- preferably 36 centimeters wide by 9.1 meters long, 

tainer 20 is opaque and the following color analysis moves in a direction indicated by arrow 150 at a rate of 

process is executed. 152 meters per minute, and has eight ejection stations 

FIGS. 6A through 6F are representative processed 60. 

images of container 20 shown at respective points A 5 Belt movement rate is used as a coarse container 

through F of the ensuing color analysis process. tracking parameter. Other container tracking parame- 

An erosion process 128 receives the binarized image ters used by general purpose processor 44 include the 

data (point B) from reflectance image processor 40 for distances along ejection conveyor 46 to each air ejector 

erosion by a diamond-shaped structuring element fitting $4, a holdoff time for each air ejector, and an actuation 

within a three-by-three square area of data. 10 duration time for each air ejector. Each air ejector 64 

A temporary image buffer 130 saves the eroded includes two separately controllable nozzles 152 that 

image (point Q. are aimed slightly upward to lift containers off ejection 

An erosion process 132 receives the once-eroded conveyor 46 during ejection, 

binarized image data (point C) from erosion process 128 Fme container tracking is necessary to account for 

and erodes it a second time with a diamond-shaped 15 unpredictable container rate of travel through inspec- 

structunng element fitting within a three-by-three tion zone 18 and transfer chute 38 and because of possi- 

square area of data (point D) . ^ uf ble shifting, floating, and rolling of containers on ejec- 

A logical process 134 exclusively-ORs the doubly tion «, Fine container tracking is provided 

eroded image (point D) and the saved once-eroded b ^ ofopposite]y facing photoelectric sensors 62 

2T( K?m SC ^ m8 **** 20 that are illuminated by complementary opposite pairs of 

\pv }. light sources 154. 

A data merging process 136 receives^ binary trace a contamerpassmg between a particular pair of pho- 

nng image data from logical process 134 (pomt E) and toelectric sensors62 and lieht sources 154 is detected 

combines it with the normalized RGB reflectance toelectric sensors W and ligm sources 154 is detected 

image data from reflectance image processor 40 (point 25 * r a hme related t0 lts P ro ^ e ' transparency, and rate. 

A). Data merging process 136 generates an RGB color G * ne f pu ^ ? r ^? r * "f 3 * c f ontamcr * T< f* 

trace ring includkig normalized RGB reflectance image akeady captured m the bmanzed refle^ceimage data 

data with the background, edge, and center data (in- * c °«tadjac«it air ejector 64 at a time 

eluding most label data) removed (point F). ?? d for a dur ? Uo * sufficie » 1 to * e «*tamer. Air 

An averaging process 138 determines the average R, 30 bla f P«ferably timed to strike a central portion of 

G, and B color data values in the color trace ring. 63430 contamer - 

The process is ended. Container 20 is opaque and has md fme container tracking is coordinated 

the RGB color determined by averaging process 138. ^ container sorting queue and tracking parame- 

If, however, decision process 126 yields a "no" an- ters b y general processor 44. Preferred container sort- 

swer, container 20 is not opaque and the following 35 ""8 categories for ejection stations 60 include: translu- 

process is executed. cent; clear transparent; green transparent; red, orange, 

A decision process 140 receives R and G data from or y eUow opaque; blue or green opaque; dark opaque; 

data merging process 122 and determines whether the ^ d white opaque. Unidentifiable containers travel off 

green data values are at least a user determined percent- ^ end of ejection conveyor 46. 

age, preferably ten percent, greater than the red data 40 Skilled workers will recognize that alternate embodi- 

values. If decision process 140 yields a "yes" answer, ments exist for portions of this invention. For example, 

container 20 is green transparent and the process is cameras other than line scanning types having sequen- 

ended. tial RGB CCD element triads may be used, as may light 

If, however, decision process 140 yields a "no" an- wavelengths other than RGB. Logic states may be in- 

swer, container 20 is not opaque or green transparent, 45 verted from those described, provided the equivalent 

and a decision process 142 analyzes the histogram data logical function is performed. Image processing may 

generated by histogram process 124. Decision process entail other than the described structuring elements, and 

142 compares the "light" histogram area to the "medi- a three-dimensional lookup table could be substituted 

um-light" histogram area to decide if container 20 is f° r window RAM 114 and window LUT 116. General 

translucent or transparent. The light area of the histo- 50 purpose processor 44 could be one of many processor 

gram curve is slightly below a "bright background" types, and the sorting program executed thereon could 

value, whereas the medium-light area is much farther be written in a wide variety of programming languages 

below the bright background value. If the medium-light including assembler. Alternatively, the sorting program 

area is at least a user determined percentage, preferably could be implemented with discrete logic components. 

65 percent, of the total light area, decision process 142 55 A histogram process or a color lookup table would be 

yields a "yes" answer, indicates that container 20 is suitable substitutes for averaging process 138. 

translucent, and ends the process. It will be obvious to those having skill in the art that 

Otherwise, decision process 142 yields a "no" an- many changes may be made to the details of the above- 
swer, indicates that container 20 is clear transparent, described embodiment of this invention without depart- 
and ends the process. 60 ing from the underlying principles thereof. Accord- 
General purpose processor 44 associates the proper ingly, it will be appreciated that this invention is also 
sorting classification with container 20 and enters these applicable to containers without labels affixed to them 
data into a container sorting queue. Sorting classifies- and to inspection and sorting applications other than 
tion data associated with each scanned and analyzed those found in plastic container sorting. The scope of 
container is added to the container sorting queue. 65 the present invention should be determined, therefore, 

FIG. 7 shows an enlarged portion of ejection con- only by the following claims, 

veyor 46 in the region of ejection station 60, shown We claim: 

ejecting container 54 (FIG. 2). Ejection conveyor 46 is 1. A plastic container sorting apparatus, comprising: 
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a presentation conveyor moving in a first direction 
and downwardly tilted in a second direction trans* 
verse to the first direction such that the plastic 
containers placed on the presentation conveyor 
tend to move in the second direction toward a 5 
stationary side barrier that stabilizes an orientation 
of the plastic containers as they are propelled by 
the presentation conveyor through an air space 
forming an inspection zone; 

a first video camera receiving reflected light from the 10 
plastic containers in the inspection zone and gener- 
ating a stream of reflectance image data; 

a second video camera receiving light transmitted 
through the plastic containers in the inspection 
zone and generating a stream of transmittance 15 
image data; and 

a processor classifying translucent ones of the plastic 
containers into translucency categories in response 
to the transmittance image data and opaque ones of 
the plastic containers into color categories in re- 20 
sponse to the reflectance image data. 

2. The apparatus of claim 1 further comprising an 
ejection conveyor that receives the plastic containers 
from the inspection zone and ejects the classified plastic 25 
containers from predetermined locations of the ejection 
conveyor, each of the predetermined locations being 
associated with one or more of the translucency and 
color categories. 

3. The apparatus of claim 1 in which the first video 3Q 
camera has a reflectance scanning plane that terminates 

in a dark cavity background. 

4. The apparatus of claim 1 further comprising: 

an illumination light source uluminating the plastic 
containers in the inspection zone, the illumination 35 
light source being the source of the reflected light 
received by the first video camera; 

a background light source producing background 
light in the inspection zone, the background light 
source being the source of transmitted light re- 40 
ceived by the second video camera; and 

a reflectance image data processor and a transmit- 
tance image data processor normalizing and bina- 
rizing the respective streams of reflectance and 
transmittance image data. 45 

5. The apparatus of claim 4 in which the illumination 
light source comprises a fluorescent lamp bent in multi- 
ple linear coplanar segments and positioned in a focal 
axis of a parabolic reflector. 

6. The apparatus of claim 1 in which the tilt of the 50 
presentation conveyor ranges from about 5 degrees to 
about 20 degrees relative to a horizontal line. 

7. The apparatus of claim 1 in which the side barrier 
has a slick surface. 

8. The apparatus of claim 1 in which the first and 55 
second video cameras are of a linear charge-coupled 
device array, line-scanning type each camera having a 
single linear array of charge-coupled device elements in 
which adjacent triads of charge-coupled device ele- 
ments are sensitive to red, green, and blue wavelengths 60 
of light, and in which the processor employs nonadja- 
cent ones of the triads to eliminate a color distortion in 
the respective streams of reflectance and transmittance 
image data. 

9. The apparatus of claim 1 in which the stream of 65 
reflectance image data includes label data and edge 
data, and in which the processor twice erodes selected 
portions of the reflectance image data to generate color 
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trace ring data that exclude the edge data and most of 
the label data. 

10. In a plastic container sorter a method of acquiring 
and processing image data, comprising the steps of: 

receiving transmittance and reflectance image data 
representative of the plastic container; 

processing the transmittance data to determine 
whether the plastic container is one of substantially 
transparent, substantially translucent, and substan- 
tially opaque; 

processing the reflectance data if the plastic container 
is substantially opaque to determine a reflected 
color of the plastic container; and 

processing the transmittance data further if the plastic 
container is one of substantially transparent and 
substantially translucent to determine whether the 
plastic container is a substantially green transmit- 
ted color. 

11. The method of claim 10 in which the plastic con- 
tainer is one of substantially transparent and substan- 
tially translucent, and is not a substantially green trans- 
mitted color, further comprising the step of analyzing 
the processed transmittance data to determine whether 
the plastic container is one of translucent and a clear 
color. 

12. The method of claim 11 further comprising the 
step of classifying the plastic container into a sorting 
category based on at least one of an opacity value, a 
translucency value, a transmitted color, and a reflected 
color of the plastic container. 

13. The method of claim 10 in which the transmit- 
tance data processing step includes the steps of: 

normalizing, binarizing, and eroding the transmit- 
tance data; 

merging the normalized, binarized; and eroded trans- 
mittance data with the transmittance data to pro- 
vide merged transmittance data; and 

analyzing the merged transmittance data to determine 
a degree of opacity for the plastic container. 

14. The method of claim 10 in which the reflectance 
data processing step includes the steps of: 

normalizing and binarizing the reflectance data; 
generating binary trace ring data twice eroding the 

normalized and bmarized reflectance data; 
merging the binary trace ring data and the reflectance 

data to generate color trace ring data; and 
analyzing the color trace ring data to determine a 

reflected color of the plastic container. 

15. A plastic container sorting apparatus, comprising: 
a presentation conveyor moving the plastic contain- 
ers through an inspection zone; 

an iUumination light source iUurninating the plastic 
containers in the inspection zone to provide a 
source of reflected light; 

a first video camera receiving the reflected light from 
the plastic containers and generating a stream of 
reflectance image data; 

a background light source having a white light dif- 
fuser and a glare shield, the white light diffuser 
providing a source of background light that is 
transmitted through the plastic containers, and the 
glare shield preventing stray light from the back- 
ground light source from being detected by the 
first video camera; 

a second video camera having a transmittance scan- 
ning plane that terminates on the white light dif- 
fuser such that the second video camera receives 
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the light transmitted through the plastic containers 
and generates a stream of transmittance image data; 

a reflectance image data processor normalizing and 
binarizing the stream of reflectance image data to 
classify the plastic containers into color categories 5 
in response to the reflectance image data; and 

a transmittance image data processor normalizing and 
b in a ri zing the stream of transmittance image data 
to classify the plastic containers into opacity cate- 
gories in response to the transmittance image data. 10 

16. A plastic container sorting apparatus, comprising: 

a presentation conveyor moving the plastic contain- 
ers through an inspection zone; 

an illumination light source illuminating the plastic 15 
containers in the inspection zone to provide a 
source of reflected light; 

a first video camera receiving the reflected light from 
the plastic containers and generating a stream of 
reflectance image data; ^ 

a background light source having a white light dif- 
fuser providing a source of background light that is 
transmitted through the plastic containers; 

a second video camera having a transmittance scan- 
ning plane that terminates on the white light dif- 25 
fuser such that the second video camera receives 
the light transmitted through the plastic containers 
and generates a stream of transmittance image data; 

a reflectance image data processor normalizing and 
binarizing the stream of reflectance image data to 30 
classify the plastic containers into color categories 
in response to the reflectance image data; and 



a transmittance image data processor normalizing and 
binarizing the stream of transmittance image data 
to classify the plastic containers into opacity cate- 
gories in response to the transmittance image data. 

17. A plastic container sorting apparatus, comprising: 

a presentation conveyor moving the plastic contain- 
ers through an inspection zone; 

a pair of scanning cameras generating respective re- 
flectance and transmittance image data streams in 
response to light received from the plastic contain- 
ers in the inspection zone, the reflectance image 
data including container profile data; 

a processor classifying the plastic containers into 
sorting categories in response to the transmittance 
and reflectance image data streams; 

a substantially smooth surfaced ejection conveyor 
moving at a rate, receiving the plastic containers 
from the inspection zone, and conveying the plastic 
containers to predetermined locations adjacent to 
the ejection conveyor, each of the predetermined 
locations being associated with one or more of the 
sorting categories; and 

a photoelectric sensor positioned adjacent to at least 
one of the predetennined locations, the sensor gen- 
erating a container tracking signal that the proces- 
sor processes together with the rate and the con- 
tainer profile data to eject particular classified ones 
of the plastic containers from the predetermined 
location by directing an air ejector blast at a central 
portion of the particular classified ones of the plas- 
tic containers. 
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